Apparatus for voice-age adjusting an input voice signal according to a desired age

ABSTRACT

According to one embodiment, an apparatus for processing a voice signal includes a display configured to display an image of a user or a character corresponding to the user, a microphone, a speaker configured to output a voice signal of the user, a memory configured to store a trained voice age conversion model, and a processor configured to, based on changing an age of the user or the character displayed on the display, control the display such that the display displays the user or the character corresponding to the changed age. The processor is further configured to determine a first age that is a current age of the user or the character based on the voice signal of the user inputted through the microphone. Accordingly, convenience of a user may be enhanced.

CROSS-REFERENCE TO RELATED APPLICATION

Pursuant to 35 U.S.C. § 119(a), this application claims the benefit ofearlier filing date and right of priority to Korean Patent ApplicationNo. 10-2019-0144486, filed on Nov. 12, 2019, the contents of which areall hereby incorporated by reference herein in their entirety.

BACKGROUND 1. Technical Field

The present disclosure relates to a method for processing a voice signalaccording to a desired age, and an apparatus to which the method isapplied.

2. Description of Related Art

Speech is the most natural means for communication, informationtransfer, and implementing language. Speech refers to sound uttered byhumans that conveys meaning.

Attempts to enable communication between humans and machines throughspeech have been continuously made. Furthermore, the field of speechinformation technology (SIT), which is for processing speech informationeffectively, has made remarkable progress. Accordingly, SIT is becomingmore and more widely used in people's lives.

In Korean Patent Application Publication No. 10-2019-0104268 (publishedon Sep. 9, 2019; hereinafter referred to as ‘related art 1’), disclosedis an artificial intelligence apparatus that obtains an original voicesignal through a microphone, performs a de-identification process on theobtained original voice signal, and recognizes the de-identified voicesignal using a voice recognition model.

However, the artificial intelligence apparatus according to related art1 recognizes the voice signal, but has a limitation in that it cannotprocess the voice signal according to the needs of various users.

SUMMARY OF THE DISCLOSURE

The present disclosure is directed to providing an apparatus and amethod for adaptively processing voice.

The present disclosure is further directed to providing an apparatus anda method for converting a speaker's voice into a voice of a desired agegroup.

The present disclosure is still further directed to providing anapparatus and a method for processing a voice signal using artificialintelligence technology.

Aspects of the present disclosure are not limited to the above-mentionedaspects, and other technical aspects not mentioned above will be clearlyunderstood by those skilled in the art from the following description.

An apparatus for processing a voice signal according to one embodimentof the present disclosure may include a receiver configured to receive avoice signal of a user, a memory configured to store a trained voice ageconversion model, and a processor configured to apply the trained voiceage conversion model to the voice signal of the user received throughthe receiver to generate a target voice signal estimated to be a voiceof a user of a pre-inputted desired age.

A method for processing a voice signal according to another embodimentof the present disclosure may include receiving a voice signal of auser, applying a pre-trained voice age conversion model to the voicesignal of the user to generate a target voice signal estimated to be avoice of a user of a pre-inputted desired age, and outputting thegenerated target voice signal.

An apparatus for processing a voice signal according to anotherembodiment of the present disclosure may include a display configured todisplay an image of a user or a character corresponding to the user, aspeaker configured to output a voice signal of the user, a memoryconfigured to store a trained voice age conversion model, and aprocessor configured to control, based on changing an age of the user orthe character displayed on the display, the display such that thedisplay displays the user or the character corresponding to the changedage.

The processor may generate the voice signal corresponding to the user orthe character of the changed age by using the voice age conversionmodel, and output the generated voice signal through the speaker.

According to various embodiments of the present disclosure, since voiceinformation corresponding to a desired age group can be outputted, evenwhen voice information on the desired age groups has not been secured,effective use is possible and user convenience can be enhanced.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a view illustrating a 5G network-based cloud system accordingto one embodiment of the present disclosure.

FIG. 2 is a block diagram illustrating a configuration of an apparatusfor processing a voice signal according to one embodiment of the presentdisclosure.

FIG. 3 is a view for illustrating a process of training and applying avoice age conversion model by supervised learning according to oneembodiment of the disclosure.

FIGS. 4 and 5 are views for illustrating a process of applying a voiceage conversion model generated by unsupervised learning according to oneembodiment of the present disclosure.

FIG. 6 is a block diagram illustrating a configuration of an apparatusfor processing a voice signal according to one embodiment of the presentdisclosure.

FIGS. 7 and 8 are views for illustrating an operation of an apparatusfor processing a voice signal according to one embodiment of the presentdisclosure.

FIG. 9 is a flow chart illustrating a method of operating an apparatusfor processing a voice signal according to one embodiment of the presentdisclosure.

DETAILED DESCRIPTION

Since various embodiments of the present disclosure may utilizetechniques relating to artificial intelligence, artificial intelligencewill be generally described below.

Artificial intelligence (AI) refers to a field of studying artificialintelligence or a methodology for creating the same. Moreover, machinelearning refers to a field of defining various problems dealing in anartificial intelligence field and studying methodologies for solving thesame. In addition, machine learning may be defined as an algorithm forimproving performance with respect to a task through repeated experiencewith respect to the task.

An artificial neural network (ANN) is a model used in machine learning,and may refer in general to a model with problem-solving abilities,composed of artificial neurons (nodes) forming a network by a connectionof synapses. The ANN may be defined by a connection pattern betweenneurons on different layers, a learning process for updating a modelparameter, and an activation function for generating an output value.

The ANN may include an input layer, an output layer, and may selectivelyinclude one or more hidden layers. Each layer includes one or moreneurons, and the artificial neural network may include synapses thatconnect the neurons to one another. In the artificial neural network,each neuron may output a function value of the activation function withrespect to input signals inputted through the synapse, weight, and bias.

A model parameter refers to a parameter determined through learning, andmay include weight of synapse connection, bias of a neuron, and thelike. Moreover, a hyperparameter refers to a parameter which is setbefore learning in a machine learning algorithm, and includes a learningrate, a number of repetitions, a mini batch size, an initializationfunction, and the like.

The objective of training an ANN is to determine a model parameter forsignificantly reducing a loss function. The loss function may be used asan indicator for determining an optimal model parameter in a learningprocess of an artificial neural network.

Machine learning may be classified into supervised learning,unsupervised learning, and reinforcement learning depending on thelearning method.

Supervised learning may refer to a method for training an artificialneural network with training data that has been given a label. Inaddition, the label may refer to a target answer (or a result value) tobe guessed by the artificial neural network when the training data isinputted to the artificial neural network. Unsupervised learning mayrefer to a method for training an artificial neural network usingtraining data that has not been given a label. Reinforcement learningmay refer to a learning method for training an agent defined within anenvironment to select an action or an action order for maximizingcumulative rewards in each state.

Machine learning of an artificial neural network implemented as a deepneural network (DNN) including a plurality of hidden layers may bereferred to as deep learning, and the deep learning is one machinelearning technique. Hereinafter, the meaning of machine learningincludes deep learning.

Reference will now be made in detail to embodiments of the presentdisclosure, examples of which are illustrated in the accompanyingdrawings. In the following description of the embodiments of the presentdisclosure, a detailed description of related arts will be omitted whenit is determined that the gist of the embodiments disclosed herein maybe obscure.

Terms such as “first,” “second,” and other numerical terms when usedherein do not imply a sequence or order unless clearly indicated by thecontext. These terms are only used to distinguish one element fromanother. In addition, terms, which are specially defined inconsideration of the configurations and operations of the embodiments,are given only to explain the embodiments, and do not limit the scope ofthe embodiments.

FIG. 1 is a view illustrating a 5G network-based cloud system 1000according to one embodiment of the present disclosure.

Referring to FIG. 1 , the cloud system 1000 may include a voice signalprocessing apparatus 100, a mobile terminal 200, an informationproviding system 300, various devices 400, and a 5G network 500.

The human voice may be generated by organs such as the vocal cords, thelarynx, the nasal cavity, and the lungs. As a human ages, the human bodynaturally changes, and as a result, the human voice also changes. Thehuman voice is changed by the growth of the body from childhood toadulthood, and by aging from adulthood to old age. In addition, in thecase of men, the human voice changes rapidly around the age of puberty.

The voice signal processing apparatus 100 is a device that mechanicallyperforms voice conversion. The voice signal processing apparatus 100 mayconvert a first voice of a speaker, which is inputted through, forexample, a microphone or various voice receivers (input interfaces) forreceiving a voice signal, into a second voice. Herein, the first voicemay be a voice of the speaker corresponding to a predetermined point intime (or age), and the second voice may be a voice of the speaker at apoint in time (or age) which is earlier or later than the point in timeof the first voice.

In the present specification, the voice signal processing apparatus 100is assumed to be a display apparatus 100. However, as alternative oradditional embodiments, various electronic devices, communicationdevices, robots, and the like may be implemented as the voice signalprocessing apparatus 100.

The voice signal processing apparatus 100 may transmit and receive datato and from servers, various communication terminals, and the like,through the 5G network 500. In particular, the voice signal processingapparatus 100 may perform data communication with the server andterminals by using at least one of enhanced mobile broadband (eMBB),ultra-reliable and low latency communications (URLLC), or massivemachine-type communications (mMTC), through the 5G network 500.

eMBB is a mobile broadband service providing, for example, multimediacontent and wireless data access. In addition, improved mobile services,such as hotspots and wideband coverage for accommodating the rapidlyincreasing mobile traffic, may be provided through the eMBB. Through ahotspot, high-volume traffic may be accommodated in an area where usermobility is low and user density is high. Through wideband coverage, awide and stable wireless environment and user mobility can be secured.

The URLLC service defines more stringent requirements than existing LTEin terms of reliability and transmission delay of data transmission andreception. A 5G service for manufacturing process automation inindustrial fields, telemedicine, remote surgery, transportation, andsafety, may correspond to a URLLC service.

mMTC is a transmission delay-insensitive service that requires arelatively small amount of data transmission. mMTC enables a much largernumber of terminals, such as sensors, than general mobile cellularphones to be simultaneously connected to a wireless access network. Insuch a case, the price of the communication module of the terminalsshould be low, and a technology improved to increase power efficiencyand save power is required to enable operation for several years withoutreplacing or recharging a battery.

The mobile terminal 200 may communicate with the voice signal processingapparatus 100 through the 5G network 500, and may provide image-basedinformation. The mobile terminal 200 may include mobile devices such asa mobile phone, a smart phone, and a wearable device (for example, asmart watch, a smart glass, or a head mounted display (HMD)).

The information providing system 300 may provide various services to thevoice signal processing apparatus 100. The information providing system300 may access information that is difficult for the voice signalprocessing apparatus 100 to access. In addition, the informationproviding system 300 may perform operations related to artificialintelligence that are difficult or take a long time for the voice signalprocessing apparatus 100 to operate. Accordingly, the informationproviding system 300 may generate a model related to artificialintelligence, and provide information related thereto to the voicesignal processing apparatus 100.

The various devices 400 may include, for example, a personal computer(PC) 400 a, an autonomous vehicle 400 b, and a home robot 400 c. Thevarious devices 400 may be connected to the voice signal processingapparatus 100, the mobile terminal 200, the information providing system300, and the like, through the 5G network 500 in a wired or wirelessmanner.

The 5G network 500 may include, for example, a 5G mobile communicationnetwork, a local area network, and the Internet, and thus may provide awired or wireless communication environment for devices.

FIG. 2 is a block diagram illustrating a configuration of the voicesignal processing apparatus 100 according to one embodiment of thepresent disclosure.

Referring to FIG. 2 , the voice signal processing apparatus 100 mayinclude a receiver 113, a speaker 143, a memory 150, and a processor190.

First, the receiver 113 may receive a voice signal. In an alternativeembodiment, the receiver 113 may be implemented as a receiver includedin a transceiver, a microphone, and various input interfaces.

The speaker 143 is a module that outputs sound, and may output a voicesignal processed by the processor 190.

The memory 150 stores data supporting various functions of the voicesignal processing apparatus 100. The memory 150 may store a plurality ofapplication programs or applications executed in the voice signalprocessing apparatus 100, and various data and instructions foroperating the voice signal processing apparatus 100.

The memory 150 may store information necessary to perform operationsusing artificial intelligence, machine learning, and an artificialneural network. The memory 150 may store a deep neural network model.The deep neural network model may be used to infer result values for newinput data other than the training data. The inferred values may be usedas a basis for the judgment to perform an operation. The memory 150 maystore clustered data, and may also store embedding vector informationthat is used in unsupervised learning.

The memory 150 may store a trained voice age conversion model 151. Thevoice age conversion model 151 may be implemented as a model based onsupervised learning or a model based on unsupervised learning.

The processor 190 may apply the voice age conversion model 151 to thevoice signal of the user received through the receiver 113.Specifically, the processor 190 may apply the voice age conversion model151 to the voice signal of the user to generate a target voice signalestimated to be a voice of a user of a pre-inputted desired age. Herein,the voice age conversion model 151 may be a model already completedthrough a training step.

Hereinafter, the operation of the processor 190 using the voice ageconversion model 151 will be described with reference to FIGS. 3 to 5 .

FIG. 3 is a view illustrating a process of training (or learning) andapplying the voice age conversion model 151A (151) by supervisedlearning, according to one embodiment of the present disclosure.

Referring to FIG. 3 , the processor 190 may train the voice ageconversion model 151A (151) in a training step Tr, and use the trainedvoice age conversion model 151A (151) in an application step App.

In general, the voice age conversion model 151A (151) may be a trainedmodel that is trained in advance by pair information that includesacoustic characteristic information corresponding to a voice signal of afirst age of each of a plurality of trainees and acoustic characteristicinformation corresponding to a voice signal of a second age.

First, describing in detail the training step Tr, the processor 190 mayreceive the voice signal of each of the plurality of trainees andextract acoustic characteristic information from the received voicesignal. The number of the trainees is not limited, and the more labelinformation, the higher the accuracy of the model.

Referring to a first trainee U1 as a representative example, theprocessor 190 may receive a voice signal U1_V from the first trainee U1.The voice signal U1_V may be a voice signal at the time of input by thefirst trainee U1. However, in an alternative embodiment, the processor190 may set a voice signal at another point in time as a reference age(or reference point in time).

The processor 190 may collect various information corresponding to thevoice signal U1_V through the input or the extraction. In addition, theprocessor 190 may set age information on the first trainee U1 as firstage information. Further, the processor 190 may collect inputinformation 310 that includes first age information 311, acousticcharacteristic information 313 extracted from the voice signal U1_V,identification information 315, gender information 316, and second ageinformation 317.

Herein, the acoustic characteristic information 313 is characteristicinformation on a sound extracted from the voice signal U1_V. In analternative embodiment, the processor 190 may extract the acousticcharacteristic information 313 using a discrete wavelet transform (DWT).The extracted acoustic characteristic information may include voicespectrum information. The acoustic characteristic information 313 mayinclude, for example, information on a fundamental frequency thatuniquely specifies a voice characteristic of the first trainee U1 andinformation on pitches that appear in multiples of the fundamentalfrequency. In an alternative embodiment, the acoustic characteristicinformation 313 may further include various information that uniquelydistinguishes the voice of the user, including tone information, tonecolor information, and the like.

Herein, the input information 310 may further include the identificationinformation 315 and the gender information 316. The identificationinformation 315 may be used to identify the user. Since particularly inthe case of men, the human voice changes rapidly around the age ofpuberty, the gender information 316 may be used to increase the accuracyof the voice age conversion model 151A (151).

The processor 190 may input label information 320. The label information320 may include acoustic characteristic information 321 on the secondage. The processor 190 may train the voice age conversion model 151A(151) such that the acoustic characteristic information outputted basedon the input information 310 follows the acoustic characteristicinformation 321 on the second age. In such a case, if necessary, errorback propagation or gradient descent may be used to minimize the lossfunction.

The processor 190 may generate and output acoustic characteristicinformation 330 on the second age. In addition, the processor 190 mayconvert the acoustic characteristic information 330 into the voicesignal U1_VR of the second age using a Griffi-Lim algorithm.

The processor 190 may train the voice age conversion model 151A (151)based on a large number of trainees, including the first trainee U1.

Next, in the application step App, when input information 340 includingacoustic characteristic information 343 on the first age that isextracted from a voice signal U2_V of a second trainee U2 is inputtedinto the voice age conversion model 151A (151), the processor 190 maygenerate and output the acoustic characteristic information 350 on thesecond age that corresponds to the inputted second age information 347.

FIGS. 4 and 5 are views for illustrating a process of applying a voiceage conversion model generated by unsupervised learning according to oneembodiment of the present disclosure. FIG. 4 is a view for describing avariational auto encoder (VAE) model, and FIG. 5 is a view fordescribing a voice age conversion model implemented as a generativeadversarial network (GAN) model.

Referring to FIG. 4 , a voice age conversion model 151B (151) may beimplemented as a VAE model.

In a training step, the processor 190 may input input information 410into the voice age conversion model 151B (151).

An encoder network 421 may be trained to receive the acousticcharacteristic information on the first age and obtain the acousticcharacteristic information on the second age. In such a case, the voiceage conversion model 151B (151) may include information (for example,mean μ (425) and variance Σ (426)) on latent variables Z (427) forconverting into acoustic characteristic information on the second agethrough the training. Herein, the latent variables Z (427) may be in theform of a Gaussian function having characteristics corresponding to theacoustic characteristic information on the second age.

The encoder network 421 may include a plurality of convolution layers. Adecoder network 423 may also include a plurality of deconvolutionlayers. The decoder network 423 may input the latent variables Z (427)into the deconvolution layers to output the acoustic characteristicinformation on the second age. The encoder network 421 may receiveacoustic characteristic information 428 on the second age, and derivethe latent variables Z (427) based on the received acousticcharacteristic information 428. The encoder network 421 and the decodernetwork 423 may be implemented as a convolutional neural network (CNN).

Referring to FIG. 5 , a voice age conversion model 151C (151) may beimplemented as the VAE model.

The processor 190 may input input information 510 into the voice ageconversion model 151C (151). A generator 521 may generate acousticcharacteristic information (sample) 525 on the second age. That is, thegenerator 521 may generate acoustic characteristic information 525corresponding to a virtual second age, and transmit, to a discriminator523, a verification request for the generated acoustic characteristicinformation 525 (S1).

The processor 190 may verify the sample 525 using the discriminator 523.The discriminator 523 has information related to acoustic characteristicinformation 527 on the second age. Thus, the discriminator 523 maydetermine a similarity between the sample 525 and the acousticcharacteristic information 527, and then provide a verification resulttherefor to the generator 521 (S2). In the training step, the processor190 makes a hypothesis using the generator 521, and may train the voiceage conversion model 151C (151) based on the result verified by thediscriminator 523.

When the training is completed, the processor 190 may output, through anoutput device such as the speaker, acoustic characteristic information530 on the second age that corresponds to the input information 510.

FIG. 6 is a block diagram illustrating a configuration of the voicesignal processing apparatus 100 according to one embodiment of thepresent disclosure.

The voice signal processing apparatus 100 may include a transceiver 110,an input interface 120, a sensor 130, an output interface 140, a memory150, a power supplier 160, and a processor 190. The components shown inFIG. 6 are not essential to implementing the voice signal processingapparatus 100, and thus the voice signal processing apparatus 100described herein may have more or fewer components than those listedabove.

The transceiver 110 may include a wired/wireless communication modulecapable of communicating with, for example, the mobile terminal 200 andthe information providing system 300.

In an alternative embodiment, the transceiver 110 may be equipped with amodule for Global System for Mobile communication (GSM), code divisionmultiple access (CDMA), long term evolution (LTE), 5G, wireless LAN(WLAN), wireless-fidelity (Wi-Fi), Bluetooth™, radio frequencyidentification (RFID), Infrared Data Association (IrDA), ZigBee, andnear field communication (NFC).

The input interface 120 may include a camera 121 for inputting an imagesignal, a microphone 123 for receiving a voice signal, and a userinterface 125 for receiving information inputted from a user. Herein,the camera 121 or the microphone 123 may be regarded as a sensor, andthus a signal obtained by the camera 121 or the microphone 123 may bereferred to as sensing data or sensor information.

The input interface 120 may obtain, for example, training data fortraining a model and input data to be used to obtain an output using thetrained model. The input interface 120 may obtain raw input data. Insuch a case, the processor 190 may extract an input feature for the rawinput data by preprocessing the raw input data.

The sensor 130 may obtain at least one of internal information on thevoice signal processing apparatus 100, surrounding environmentinformation on the voice signal processing apparatus 100, or userinformation, using various sensors.

Herein, the sensor 130 may include a satellite-based location sensor, adistance detection sensor, an illumination sensor, an accelerationsensor, a magnetic sensor, a gyroscope sensor, an inertial sensor, anRGB sensor, an infrared (IR) sensor, a finger scan sensor, an ultrasonicsensor, an optical sensor, a microphone, a light detection and ranging(lidar) sensor, a barometer sensor, or a radar sensor.

The output interface 140 may generate a visual, auditory, or tactilerelated output, and may include an optical output interface or thedisplay 141 for outputting visual information, the speaker 143 foroutputting auditory information, and a haptic module for outputtingtactile information.

Herein, the display 141 may display, under the control of the processor190, an image of a user or a character that is mappable to the user. Inaddition, the speaker 143 may output the voice signal of the user.

The memory 150 stores data supporting various functions of the voicesignal processing apparatus 100. The memory 150 may store the pluralityof application programs or applications executed in the voice signalprocessing apparatus 100, and various data and instructions foroperating the voice signal processing apparatus 100.

In addition, the memory 150 may store information necessary to performoperations using artificial intelligence, machine learning, and anartificial neural network. The memory 150 may store the deep neuralnetwork model. The deep neural network model may be used to infer resultvalues for new input data other than training data. The inferred valuesmay be used as the basis for a judgment to perform an operation. Thememory 150 may store clustered data, and may also store embedding vectorinformation that is used in unsupervised learning.

The memory 150 may store the voice age conversion model 151. The voiceage conversion model 151 may store, as big data, a tendency of theacoustic characteristic information extracted from the voice. When thevoice age conversion model receives information on a first point intime, voice information corresponding to the first point in time, andinformation on a second point in time, the voice age conversion modelmay convert the voice information corresponding to the first point intime into the voice information corresponding to the second point intime. For example, when the voice age conversion model receives voiceinformation corresponding to a speaker's childhood and information on aparticular point in time of the speaker's old age, the voice ageconversion model may generate voice information corresponding to theparticular point in time of the old age.

The memory 150 may store voice information on various users in the formof big data. The processor 190 may generate an artificial intelligencemodel by using the stored voice information in the form of big data, andmay improve performance by using the generated artificial intelligencemodel.

Under the control of the processor 190, the power supplier 160 receivespower from an external power source and an internal power source, andsupplies the power to each component of the voice signal processingapparatus 100. The power supplier 160 includes a battery which may be abuilt-in battery or a replaceable battery. The battery may be chargedvia a wired or wireless charging method, and the wireless chargingmethod may include a magnetic induction method or a magnetic resonancemethod.

The processor 190 is a module that controls the components of the voicesignal processing apparatus 100, and may include one or more processors.The processor 190 may refer to a hardware-embedded data processingdevice having a physically structured circuit to execute functionsrepresented as instructions or codes included in a program. Examples ofsuch hardware-embedded data processing device may include, but are notlimited to, processing devices such as a microprocessor, a centralprocessing unit (CPU), a processor core, a multiprocessor, anapplication-specific integrated circuit (ASIC), and a field programmablegate array (FPGA).

The processor 190 may be configured to, based on changing the age of theuser or the character displayed on the display 141, control the display141 such that the display 141 displays a user or a charactercorresponding to the changed age.

Instructions to change the age may be executed by an application capableof controlling the display 141, the speaker 143, and the microphone 123.

The processor 190 may generate a voice signal corresponding to the useror the character of the changed age by using the voice age conversionmodel 151, and output the generated voice signal through the speaker143.

The voice age conversion model 151 may be a model that is based onsupervised learning or unsupervised learning, and may be generated as aVAE model or a GAN model as described above. The above descriptions ofFIG. 2 may also be applied to the voice signal processing apparatus 100,so a detailed description thereof will be omitted. In addition, thevoice age conversion model 151 may be generated using a sequence tosequence (Seq2Seq) algorithm and an attention technique, but theembodiments are not limited thereto.

Hereinafter, the operations of the voice signal processing apparatusaccording to one embodiment of the present disclosure will be describedwith reference to FIGS. 7 and 8 .

Referring to FIG. 7 , the voice signal processing apparatus 100 maylaunch an application that is capable of controlling the camera 121, thedisplay 141, and the speaker 143. The contents described in FIGS. 7 and8 may be performed through the application. Reference is made to theabove-mentioned reference numerals.

The voice signal processing apparatus 100 may include the camera 121 forphotographing a user U5 (grandmother). The voice signal processingapparatus 100 may display the user U5 as a user image GM (GM1) on thedisplay 141. The user image GM (GM1) may be an image generated byphotographing the user U5 using the camera 121.

The user U5 may make a spoken utterance of “Oh, my legs hurt” GT1. Then,the voice signal processing apparatus 100 may receive a voice signalrelated to the spoken utterance GT1 through the microphone 123, and thenoutput voice information of “Oh, my legs hurt” GT2 through the speaker143.

When a trigger command is inputted (30), the processor 190 may performcontrol corresponding to the trigger command. Herein, the triggercommand may be a command to change the user image GM (GM1) on thedisplay 141 to a predetermined age.

When the voice signal processing apparatus 100 receives the triggercommand (30), the voice signal processing apparatus 100 may display anappearance GM (GM2) of the user U5 on the display 141, and outputconverted voice GT3 through the speaker 143, based on a pre-inputtedage. The appearance GM (GM2) may be an image previously stored in thevoice signal processing apparatus 100, or may be an image rendered basedon an image received from the information providing system 300.

In an alternative embodiment, the voice signal processing apparatus 100may receive information on the second age that is the changed desiredage, and then output, through the speaker 143, a voice signalcorresponding to the second age based on the voice age conversion model151. (For example, the information on the second age may be received viathe microphone or the user interface, or may be stored in advance).

In addition, when the voice signal processing apparatus 100 receives thevoice signal of the user through the microphone 123, the voice signalprocessing apparatus 100 may estimate the age of the received voicesignal and then determine the estimated age as the first age that is thecurrent age. In an alternative embodiment, the processor 190 may beimplemented to explicitly receive the first age.

When the voice signal processing apparatus 100 receives, through themicrophone 123, a command to change the age of the user U5 or thecharacter (for example, CA in FIG. 8 ) corresponding to the user U5 fromthe first age to the second age, the voice signal processing apparatus100 may control the display 141 such that the display 141 displays theimage corresponding to the second age, and may control the speaker 143such that the speaker 143 outputs the voice signal corresponding to thesecond age.

Referring to FIG. 8 , the voice signal processing apparatus 100 maydisplay, on the display 141, a character CA (CA1) corresponding to auser. In addition, the voice signal processing apparatus 100 may outputa spoken utterance 820 (820 a) of the character CA (CA1) through thespeaker 143.

When the voice signal processing apparatus 100 receives a command tooutput a voice converted into the predetermined age, the voice signalprocessing apparatus 100 may output an appearance CA (CA2) and a voicesignal 820 (820 b) that reflect the converted voice.

FIG. 9 is a flow chart for describing the operation of the voice signalprocessing apparatus 100 according to one embodiment of the presentdisclosure.

First, the voice signal processing apparatus 100 receives the voicesignal of the user (S910).

Next, the voice signal processing apparatus 100 applies the pre-trainedvoice age conversion model to the voice signal of the user (S920).

Herein, the voice age conversion model may be a model based onsupervised learning or unsupervised learning, and may be a trained modeltrained in advance by the pair information that includes the voicecharacteristic information corresponding to the voice signal of thefirst age and the voice characteristic information corresponding to thevoice signal of the second age.

Thereafter, the voice signal processing apparatus 100 generates a targetvoice signal of the pre-inputted desired age (S930).

Thereafter, the voice signal processing apparatus 100 outputs thegenerated target voice signal (S940).

The present disclosure described above may be implemented as acomputer-readable code in a medium on which a program is recorded. Thecomputer-readable medium includes all types of recording devices inwhich data readable by a computer system can be stored. Examples of thecomputer-readable medium may include a hard disk drive (HDD), a solidstate disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, amagnetic tape, a floppy disk, an optical data storage device, and thelike. Further, the computer may include the processor 190 of the voicesignal processing apparatus 100.

In the foregoing, while specific embodiments of the present disclosurehave been described for illustrative purposes, the scope or spirit ofthe present disclosure is not limited thereto, it will be understood bythose skilled in the art that various changes and modifications may bemade to other specific embodiments without departing from the spirit andscope of the present disclosure. Therefore, the scope of the presentdisclosure should be defined not by the above-described embodiments butby the technical idea defined in the following claims.

What is claimed is:
 1. An apparatus for processing a voice signalcomprising: a display configured to display an image of a user or acharacter corresponding to the user; a microphone; a speaker configuredto output a voice signal of the user; a memory configured to store atrained voice age conversion model; and a processor configured to, basedon changing an age of the user or the character displayed on thedisplay, control the display such that the display displays the user orthe character corresponding to the changed age, wherein the trainedvoice age conversion model is trained using supervised learning, whereinthe processor is further configured to generate a voice signalcorresponding to the user or the character of the changed age by usingthe trained voice age conversion model, and output the generated voicesignal through the speaker, wherein the processor is further configuredto determine a first age that is a current age of the user or thecharacter based on the voice signal of the user inputted through themicrophone, wherein the trained voice age conversion model is pretrainedin a training step by using pair information that comprises acousticcharacteristic information corresponding to a voice signal of a firstage of each of a plurality of trainees and acoustic characteristicinformation corresponding to a voice signal of a second age of each of aplurality of trainees, wherein the trained voice age conversion modelreceives identification information and gender information on each of aplurality of trainees in the training step, wherein the acousticcharacteristic information comprises tone information, tone colorinformation, fundamental frequency information, and pitch informationthat are extracted from a voice of each of the plurality of trainees. 2.The apparatus according to claim 1, wherein the processor is furtherconfigured to: cause a display, on the display, of an image of the useror the character corresponding to the first age; and output, through thespeaker, a voice signal of the user corresponding to the first age. 3.The apparatus according to claim 2, wherein the processor is furtherconfigured to: launch a predetermined application that causes the imageof the user or the character to be outputted on the display; and set asecond age through the predetermined application, wherein the second ageis a desired age of the user or the character.
 4. The apparatusaccording to claim 3, wherein the processor is further configured to:based on a command to change the age of the user or the character fromthe first age to the second age being inputted through the microphone orthe predetermined application; control the display such that the displaydisplays an image corresponding to the second age; and control thespeaker such that the speaker outputs a voice signal corresponding tothe second age.